Abstract: Many techniques have been developed to control robotic systems using various human computer interaction (HCI) mechanisms. One such method is by using gestures. We have implemented a prototype using gesture as a tool for communicating with machine. Command signals are generated using certain gesture control algorithm. These generated signals are then given to the robot for navigation in specific direction. In previously developed systems, if the robot experiences any obstacles, it either becomes immobile or collides with it. Therefore, we present in our prototype a robotic arm, which will try to remove any obstacle in its path. Gesture command can also be used to operate any robotic system which helps to simplify human task. This paper provides an aid to collaboratively control robot with robotic hand using real time image processing.

Keywords: HCI; gestures; command signals;navigation; image processing.